Statistical motion-based video indexing and retrieval

We propose an original approach for the characterization of video dynamic content with a view to supplying new functionalities for motion-based video indexing and retrieval with query by example. We have designed a statistical framework for motion content description without any prior motion segmentation, and for motion-based video classi cation and retrieval. Contrary to other proposed methods, we do not extract from a given video sequence a set of motion features but we identify a global probabilistic model, expressed as a temporal Gibbs random eld. This leads to de ne a e cient statistical motion-based similarity measure, relying on the computation of conditional likelihoods, to discriminate various motion contents. We have carried out experiments on a set of 100 video sequences, representative of various motion situations (temporal textures as re and crowd motions, sport videos, car sequences, low motion activity examples). We have obtained promising results both for the video classi cation step and for the retrieval process.